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Abstract 

We study the synchronization of coupled dynamical systems on a variety of net- 
fT) ' works. The dynamics is governed by a local nonlinear map or flow for each node of 

the network and couplings connecting different nodes via the links of the network. 
For small coupling strengths nodes show turbulent behavior but form synchronized 
Q ' clusters as coupling increases. When nodes show synchronized behaviour, we ob- 

serve two interesting phenomena. First, there are some nodes of the floating type 
that show intermittent behaviour between getting attached to some clusters and 
evolving independently. Secondly, we identify two different ways of cluster forma- 
tion, namely self-organized clusters which have mostly intra-cluster couplings and 
driven clusters which have mostly inter-cluster couplings. 
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1 Introduction 
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Several complex systems have underlying structures that are described by 
networks or graphs [T1I2] . Recent interest in networks is due to the discovery 
that several naturally occurring networks come under some universal classes 
and they can be simulated with simple mathematical models, viz small-world 
networks [3], scale-free networks [lj etc. 

Several networks in the real world consist of dynamical elements interacting 
with each other and the interactions define the links of the network. Several of 
these networks have a large number of degrees of freedom and it is important to 
understand their dynamical behavior. Here, we study the synchronization and 
cluster formation in networks consisting of interacting dynamical elements. A 
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general model of coupled dynamical systems on networks will consist of the 
following three elements. 

(1) The evolution of uncoupled elements. 

(2) The nature of couplings. 

(3) The topology of the network. 

Most of the earlier studies of synchronized cluster formation in coupled chaotic 
systems have focused on networks with large number of connections (~ N 2 ) 
[6]. In this paper, we consider networks with number of connections of the 
order of N. This small number of connections allows us to study the role that 
different connections play in synchronizing different nodes and the mechanism 
of synchronized cluster formation. The study reveals two interesting phenom- 
ena. First, when nodes form synchronized clusters, there can be some nodes 
which show an intermittent behaviour between independent evolution and evo- 
lution synchronized with some cluster. Secondly, the cluster formation can be 
in two different ways, driven and self-organized phase synchronization [5] . The 
connections or couplings in the self-organized phase synchronized clusters are 
mostly of the intra-cluster type while those in the driven phase synchronized 
clusters are mostly of the inter-cluster type. 



2 Coupled dynamical systems and synchronized clusters 



Consider a network of N nodes and N c connections (or couplings) between the 
nodes. Let each node of the network be assigned an m-dimensional dynamical 
variable x*, i — 1, 2, . . . , N. A very general dynamical evolution can be written 

as 

^ = F({x,}). (1) 

In this paper, we consider a separable case and the evolution equation can be 
written as, 



^ = f(^) + ^ E sM- (2) 



j'e{fci} 



where e is the coupling constant, ki is the degree of node i, and {ki} is the set 
of nodes connected to the node i. A sort of diffusion version of the evolution 
equation (T5]) is 

^ = f ( x *) + T E (g( x .) - S( x *)) • (3) 
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Discrete versions of Eqs. (|2J) and (J3]) are 



x i (t+l) = f(x i (t)) + f £ g(^(*))- 



(4) 



and 



x i (t+l) = f( Xi (t)) + i- £ (g(x,(t))-g(x l (t))). 



(5) 



For the discrete evolution we use logistic or circle maps while for the continuous 
case we use Lorenz or Rossler systems. 

2.1 Phase synchronization and synchronized clusters 

Synchronization of coupled dynamical systems [7j is manifested by the appear- 
ance of some relation between the functionals of different dynamical variables. 
The exact synchronization corresponds to the situation where the dynamical 
variables for different nodes have identical values. The phase synchronization 
corresponds to the situation where the dynamical variables for different nodes 
have some definite relation between their phases [8l|9] . When the number of 
connections in the network is small (Nq ~ N) and when the local dynamics 
of the nodes (i.e. function f(x)) is in the chaotic zone, and we look at exact 
synchronization, we find that only few synchronized clusters with small num- 
ber of nodes are formed. However, when we look at phase synchronization, 
synchronized clusters with larger number of nodes are obtained. Hence, in our 
numerical study we concentrate on phase synchronization. 



3 General properties of synchronized dynamics 

We consider some general properties of synchronized dynamics. They are valid 
for any coupled discrete and continuous dynamical systems. Also, these prop- 
erties are applicable for exact as well as phase or any other type of synchro- 
nization and are independent of the type of network. 

3. 1 Behavior of individual nodes 

As the network evolves, it splits into several synchronized clusters. Depending 
on their asymptotic dynamical behaviour the nodes of the network can be 
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divided into three types. 

(a) Cluster nodes: A node of this type synchronizes with other nodes and 
forms a synchronized cluster. Once this node enters a synchronized cluster it 
remains in that cluster afterwards. 

(b) Isolated nodes: A node of this type does not synchronize with any other 
node and remains isolated for all the time. 

(c) Floating Nodes: A node of this type keeps on switching intermittently 
between an independent evolution and a synchronized evolution attached to 
some cluster. 

Of particular interest are the floating nodes and we will discuss some of their 
properties afterwards. 



3.2 Mechanism of cluster formation 

The study of the relation between the synchronized clusters and the couplings 
between the nodes represented by the adjacency matrix C shows two different 
mechanisms of cluster formation [5fl0] . 

(i) Self-organized clusters: The nodes of a cluster can be synchronized because 
of intra-cluster couplings. We refer to this as the self-organized synchronization 
and the corresponding synchronized clusters as self-organized clusters. 

(ii) Driven clusters: The nodes of a cluster can be synchronized because of 
inter-cluster couplings. Here the nodes of one cluster are driven by those of the 
others. We refer to this as the driven synchronization and the corresponding 
clusters as driven clusters. 

In our numerical studies we have been able to identify ideal clusters of both the 
types, as well as clusters of the mixed type where both ways of synchronization 
contribute to cluster formation. (Fig. 1 of Ref. [S] gives examples of ideal as 
well as mixed clusters in coupled map networks.) In general we find that the 
scale free networks and the Caley tree networks lead to better cluster formation 
than the other types of networks with the same average connectivity. 

Geometrically the two mechanisms of cluster formation can be easily under- 
stood by considering a tree type network. A tree can be broken into different 
clusters in different ways. 

(a) A tree can be broken into two or more disjoint clusters with only intra- 
cluster couplings by breaking one or more connections. Clearly, this splitting 
is not unique and will lead to self-organized clusters. Figure [T](a) shows a 
tree forming two synchronized clusters of self-organized type. This situation 
is similar to an Ising ferromagnet where domains of up and down spins can be 
formed. 

(b) A tree can also be divided into two clusters by putting connected nodes 
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into different clusters. This division is unique and leads to two clusters with 
only inter-cluster couplings, i.e. driven clusters. Figure []Jb) shows a tree form- 
ing two synchronized clusters of the driven type. This situation is similar to 
an Ising anti-ferromagnet where two sub-lattices of up and down spins are 
formed. 

(c) Several other ways of splitting a tree are possible. E.g. it is easy to see that 
a tree can be broken into three clusters of the driven type. This is shown in fig- 
ure []Jc). There is no simple magnetic analog for this type of cluster formation. 
It can be observed close to a period three orbit. We note that four or more 
clusters of the driven type are also possible. As compared to the cases (a) and 
(b) discussed above which are commonly observed, the clusters of case (c) are 
not so common and are observed only for some values of the parameters. 






(a) 



(b) 



(c) 



Fig. 1. Different ways of cluster formation in a tree structure are demonstrated. The 
open, solid and gray circles show nodes belonging to different clusters, (a) shows 
two clusters of the self-organized type, (b) shows two clusters of driven type and 
(c) shows three clusters of the driven type. 



4 Linear stability analysis 



A suitable network to study the stability of self-organized synchronized clus- 
ters is the globally coupled network. The stability of globally coupled maps 
is well studied in the literature [TTfl2lll3] . An ideal example to consider the 
stability of the driven synchronized state is a complete bipartite network. A 
complete bipartite network consists of two sets of nodes with each node of one 
set connected with all the nodes of the other set and no connection between 
the nodes of the same set. Let iV\ and N 2 be the number of nodes belonging 
to the two sets. We define a bipartite synchronized state as the one that has 
all Ni elements of the first set synchronized to some value, say Xi(t), and all 
N 2 elements of the second set synchronized to some other value, say X 2 (t). 
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All the eigenvectors and the eigenvalues of the Jacobian matrix for the bi- 
partite synchronized state can be determined explicitly. The eigenvectors of 
the type (a, a, /?,... , (3) T determine the synchronization manifold and this 
manifold has dimension two. All other eigenvectors correspond to the trans- 
verse manifold. Lyapunov exponents corresponding to the transverse eigen- 
vectors for Eq. (j3J) with one dimensional variables and g(x) = f(x) are 

A 1 = ln|(l- e )| + i lim^lnl/'MI, 

T t=i 

A 2 = In |(1 — e) | + - lim ± In | f\X 2 ) \ , (6) 
T t=i 

and Ai and A 2 are respectively Ni — 1 and N 2 — 1 fold degenerate [TO]. Here, 
f'fXi) and f[X 2 ) are the derivatives of f(x) at X\ and X 2 respectively. The 
synchronized state is stable provided the transverse Lyapunov exponents are 
negative. If /' is bounded then from Eqs. ([6]) we see that for e larger than 
some critical value, e&(< 1), bipartite synchronized state will be stable. Note 
that this bipartite synchronized state will be stable even if one or both the 
remaining Lyapunov exponents corresponding to the synchronization manifold 
are positive, i.e. the trajectories are chaotic. The linear stability analysis for 
other type of couplings and dynamical systems can be done along similar lines. 



5 Floating nodes 

We had noted earlier that the nodes can be divided into three types, namely 
cluster nodes, isolated nodes and floating nodes, depending on the asymptotic 
behavior of the nodes. Here, we discuss some properties of the floating nodes 
which show an intermittent behavior between synchronized evolution with 
some cluster and an independent evolution. 

Let t denote the residence time of a floating node in a cluster (i.e. the contin- 
uous time interval that the node is in a cluster). Figure [2] plots the frequency 
of residence time v(t) of a floating node as a function of the residence time r. 
A good straight line fit on log-linear plot shows an exponential dependence, 

u(t) ~ exp(-r/r r ) (7) 

where r r is the typical residence time for a given node. We have also studied the 
distribution of the time intervals for which a floating node is not synchronized 
with a given cluster. This also shows an exponential distribution. 
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Fig. 2. The figure plots the frequency of residence time v{r) of a floating node in a 
cluster as a function of the residence time r. A good straight line fit on log-linear 
plot shows exponential dependence. 



Let us now consider the condition for the occurrence of floating nodes. Con- 
sider a floating node in a cluster. The stability of this cluster is ensured if the 
transverse Lyapunov exponents are all negative. The floating node will leave 
the cluster provided the conditional Lyapunov exponent for this node, assum- 
ing that the other nodes in the cluster remain synchronized, changes sign and 
becomes positive. Thus the fluctuation of the conditional Lyapunov exponent 
about zero can be taken as the condition for the existence of a floating node. 



Several natural systems show examples of floating nodes, e.g. some birds may 
show intermittent behaviour between free flying and flying in a flock. An 
interesting example in physics is that of particles or molecules in a liquid 
in equilibrium with its vapor where the particles intermittently belong to 
the liquid and vapor. Under suitable conditions it is possible to argue that 
the residence time of a tagged particle in the liquid phase should have an 
exponential distribution [10], i.e. a behavior similar to that of the floating 
nodes (Eq. ©). 
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6 Conclusion and Discussion 

We have studied the properties of coupled dynamical elements on different 
types of networks. We find that in the course of time evolution they form 
synchronized clusters. 

In several cases when synchronized clusters are formed there are some isolated 
nodes which do not belong to any cluster. More interestingly there are some 
floating nodes which show an intermittent behavior between an independent 
evolution and an evolution synchronized with some cluster. The residence time 
spent by a floating node in the synchronized cluster shows an exponential 
distribution. 

We have identified two mechanisms of cluster formation, self-organized and 
driven phase synchronization. For self-organized clusters intra-cluster cou- 
plings dominate while for driven clusters inter-cluster couplings dominate. 
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